Work extremum principle: Structure and function of quantum heat engines 
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We consider a class of quantum heat engines consisting of two subsystems interacting via a unitary 
transformation and coupled to two separate baths at different temperatures Th > T c . The purpose 
of the engine is to extract work due to the temperature difference. Its dynamics is not restricted 
to the near equilibrium regime. The engine structure is determined by maximizing the extracted 
work under various constraints. When this maximization is carried out at finite power, the engine 
dynamics is described by well-defined temperatures and satisfies the local version of the second law. 
In addition, its efficiency is bounded from below by the Curzon-Ahlborn value 1— y/T c /Th and from 
above by the Carnot value 1 — (T c /Th)- The latter is reached — at finite power — for a macroscopic 
engine, while the former is achieved in the equilibrium limit TJ, — > T c . When the work is maximized 
at a zero power, even a small (few-level) engine extracts work right at the Carnot efficiency. 

PACS numbers: PACS: 05.30.-d, 05.70.Ln 



I. INTRODUCTION. 

Heat engines are natural or artificial devices, the 
goal of which is to extract work (high-graded energy) 
from non-equilibrium sources of heat (low-graded energy) 
[1, 2]. There are three basic characteristics of the engine 
operation: i) the work extracted per cycle; ii) the effi- 
ciency with which the input heat is converted into work; 
Hi) the power of work-extraction, i.e. the work-extracted 
per cycle divided over the cycle duration. 

Heat engines may evolve in time toward states that 
provide (constrained) optimization of their functional 
characteristics. Here are three examples from largely dif- 
ferent fields: 

1. The modern artificial engines are much more pow- 
erful and efficient than those which started the Industrial 
Revolution. The cause of this improvement are engineer- 
ing efforts driven by our desire to get more high-graded 
energy at a lower cost. 

2. A similar trend is seen in biology and ecology. 
Driven by evolution, higher organisms and more devel- 
oped ecosystems have more refined and more optimal 
means of extracting energy from their respective envi- 
ronment [3] . This observation led to several quantitative 
formulations, which were verified experimentally [3]. 

3. The earth atmosphere can approximately be re- 
garded as a huge heat-engine operating between two ther- 
mal baths (cold bath of the earth surface and eventually 
the hot bath of the sun) and producing as output large- 
scale turbulent motion of air and vapor [4]. As verified 
by observation [4], this engine is also tuned to extract 
the maximal work [4], although the precise mechanism 
of this tuning is unclear yet. 

Needless to stress that in all above situation the op- 



timization of heat engines proceeds in the presence of 
constraints that determine the very path of the engine 
evolution. This fact is especially important in the above 
bio-ecological perspective. 

The purpose of this paper is to understand the struc- 
ture of quantum heat engines emerging from the maxi- 
mization of work (produced per cycle) under specific con- 
straints. The study of quantum engines started in 60's 
[5] , when it was realized that many models of lasers and 
masers are in fact quantum heat engines. A good re- 
view of this early activity is given in [6]. Nowadays the 
physics of quantum heat engines is a rich field[7-9, 11-21] 
related to other branches of modern quantum theory; see 
[22] for a recent review of engines in the context of quan- 
tum information theory. We see two basic reasons for 
studying quantum heat engines: i) understanding of how 
thermodynamics emerges from the quantum mechanics; 
ii) clarifying principal possibilities of nano-scale devices. 

Our analysis starts from quantum mechanics and does 
not rely on the validity of thermodynamical concepts nor- 
mally invoked in studying heat engines [1, 2]. (Relying 
on quantum mechanics does not preclude us from consid- 
ering macroscopic systems.) We allow the intermediate 
states of the engine to be arbitrary far from equilibrium. 
We shall however see that local thermodynamical con- 
cepts — such as the existence of local temperatures in the 
intermediate stages of the engine functioning, or the va- 
lidity of local formulations of the second law — emerge as 
a result of maximizing the produced work. 

Our model will consist of two quantum systems R and 
S interacting with thermal baths at temperatures Th and 
T c , respectively (Th > T c ); see Fig. 1. The number of 
energy levels for R and S is finite, but it can be made very 
large going to the macroscopic limit. R and S interact 



2 



with an external work-source producing work and then 
relax back to equilibrium under influence of the baths. 
For given temperatures (and given number of subsystem 
energy levels) work maximization can be introduced on 
three different levels: (1.) One optimizes the extracted 
work over the interaction of R and S with the external 
source of work (2.) One maximizes the work, in addition, 
over the spectral structure of R and S. (3.) Finally, one 
optimizes the extracted work also over the interaction 
of R and S with their respective thermal baths. In the 
following we will investigate these strategies in full detail. 

Our main results are that on the second level of op- 
timization the efficiency at the maximal work is al- 
ways bounde d from below by the Curzon-Ahlborn value 
I — \JT C /Th- This is in addition to the upper bound 
given by the Carnot value 1 — (T c /T h ), which for the 
present setup holds generally, i.e., without any optimiza- 
tion. For any number of energy levels of R and S the 
Curzon-Ahlborn value is reached in the equilibrium limit 
Th — > T c . When the number of levels for R and S become 
very large (macroscopic limit), the efficiency reaches the 
Carnot value 1 — (T c /Th). In contrast to the standard 
thermodynamic realization of the Carnot efficiency, in 
our situation this efficiency is reached at a finite power. 
The third level of optimization is related to making the 
power very small. Now even a finite (two)-level systems 
R and S may be employed for extraction of a finite [per 
cycle] amount of work right at the Carnot efficiency. 

This paper is organized as follows. Section II describes 
the studied model for a quantum heat engine. Here we 
also recall the derivation of the Carnot bound for the ef- 
ficiency and address the problem of the power of work. 
In section III we discuss the optimization of work over 
the interaction with the sources. In section IV we report 
the results emerged from maximizing the work over the 
spectral structure of the involved quantum systems. In 
particular, we show that the Curzon-Ahlborn value is a 
lower bound for the efficiency, and we describe how one 
can employ a macroscopic engine for work-extraction at 
a finite power and with the Carnot efficiency. In sec- 
tion V we sacrify the finite-power condition, and show 
that a finite-level quantum engine can extract work right 
at the Carnot efficiency. The last section presents our 
conclusions, discusses some open questions and compares 
our findings with the results obtained previously. Several 
technical issues are discussed in appendices. 



II. THE MODEL 

Our engine consists of two quantum systems R and S 
which individually and in parallel couple to two different 
thermal baths and interact with a source of work; see 
Fig. 1 . In the first step R and S undergo a work extraction 
process driven by the source. In the second step R and 
S relax back to their initial states under influence of the 
baths. Thus thermodynamic machine cycle is performed. 




FIG. I: A schematic representation of the considered quan- 
tum engine. Quantum systems R and S interact with thermal 
baths at temperatures T h and T c , respectively. The mutual 
interaction between them is governed by the potential V(t) 
that also serves to deliver work to an external source. The 
mutual interaction is switched on for a short time only. Once 
it is switched off, the systems S and R do relax to equilib- 
rium under influence of the respective thermal baths. Similar 
constructions of quantum heat engines appeared in [7, 10, 11]. 



A. Initialization 

Consider the two finite quantum systems R and S with 
Hamiltonians H R and H$, respectively. R (S) has n (m) 
energy levels. In the scenarios studied here almost all 
operators involved will be diagonal in the energy repre- 
sentation. Thus we write 

H R = diag[e„, ...,£i], £„>... >£i, (1) 
H s = diag\fj, m ,...,fi 1 ], Mm>->Mi. ( 2 ) 

where diag[a, ..,6] is a diagonal matrix with entries 
(a, b). We will take 

£i = Mi = 0, (3) 

that is the energies of both systems are measured from 
zero. It will be seen below that this choice does not imply 
any loss of generality. Thus, ek and /i; are the energy level 
spacings. The total Hamiltonian is 

nm 

H = H R ®l + l®H s = Y / E a \E a )(E a \, (4) 

a=l 

= diag[e„ + fj, n ,e n + /U„_i, ...,£i + /z 2 ,£i + Mi], (5) 

where {E a }™ 1 and {l-E^la^i are, respectively, eigen- 
values and eigenvectors of Hr <8> 1 + 1 ® Hg- 

Subsystem R (S)is now assumed to couple to a thermal 
bath at temperature Th (T c ); see Fig. 1. We shall assume: 

T h > T c . (6) 

At this stage there is no mutual coupling between R 
and S, and each bath drives its corresponding subsystem 
to an equilibrium state specified by the Gibbss density 
matrices 

e -PhH R e ~l3aH s 

P= tre^ ff R' a= tre-^ ff s' ^ 
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where Th = l/Ph and T c — 1/(3 C . Alternatively, 



2. Second step: Relaxation 



p = diag[r„,...,n], r n < ... < n, (8) 

<7 = diag[s m ,...,si], s m < ... < s 1 , (9) 

e k =T h ln^, k = l,...,n, (10) 

m=T c \n—, l = l,...,m. (11) 

si 



(12) 



The overall initial density matrix is 

nm 
a=l 

= diag[r„s„,r„s„_i,r„s„_ 2 , ...,nsi], (13) 
and the average initial energy 

nm 



(14) 



a=l 



B. Two step process 

1. First step: Unitary transformation 

Now R + S are taken to interact via a time-dependent 
potential V(t) so that their Hamiltonian reads 

H(t) = F R ® 1 + 1®H S + V(t), (15) 
=0 for t < and for t > r. (16) 

This means that the initial and final Hamiltonian (i.e. 
before and after this first step) are both given by (4). 
The potential V{t) in (15) is assumed to be sufficiently 
strong [and to act in a sufficiently short time] so that the 
influence of the thermal baths between the times and 
r can be neglected. We require this step to be thermally 
isolated, since, otherwise, for the couplings to the baths 
being on, one would get a direct heat exchange between 
the baths, a factor that should decrease the overall ef- 
ficiency of the work-extraction. Thus the dynamics of 
R + S is unitary for < t < t: 



-f 

Jo 



dtn(t) 



(17) 



where f2; n is the initial density matrix defined in (12), 
flfin is the final density matrix, hi is the unitary evolu- 
tion operator, and Texp is the chronologically ordered 
exponent. The work extracted in this step reads 



W nm (T h , T c , e, (i, V) = tv[H (fi in - f> fin ) ; 



(18) 



This work W depends on a set of parameters: The num- 
ber of energy levels n and m for R and S, respectively, the 
spectra e and fi according to (2), and the potential V{t). 
In the following we do not make explicit the dependence 
of W on the temperatures Th and T c , which are taken to 
be fixed conditions in all cases. 



After V(t) has been switched off, which means that the 
final Hamiltonian is again given by (4), R and S (after 
some relaxation time) return to the initial states (7, 12), 
under influence of the two thermal baths as introduced 
before. This completes the two-step cycle; now the same 
heat to work transformation can be repeated. 

During the relaxation the thermal baths at tempera- 
tures Th and T c get, respectively, the amounts of heat 

Q h - tr(H R p) - tr(H R ® 1 O fin ), (19) 
Q c = tr(ff s a)-tr(ffs®lft fin ). (20) 

The work (18) is expressed as W nm (e, /x, V) = Qh + Qc- 
Following to [10, 23] we determine how Qh and Q c re- 
late to the temperatures. Recall that the relative entropy 
between two density matrices p\ and pi is defined as [24] 



S[pi\\p2\ = tr[pi lnpi - pi lnp 2 ]- 



(21) 



This non-negative quantity reflects the difference be- 
tween p\ and p2- S^piH/^] = if and only if p\ = p2 
[24] . Due to the unitarity of the work-extracting process 
(17), tr[Sli n In Sli n ] = tr[Slfi n In ilfin] , where f2; n and f2fi n 
are defined by (12) and (17). We get 



< 0. 



(22) 



If a non-negative amount of work is extracted, 
W nm (e,p,V) = Q h + Qc > 0, Eq. (22) implies 
W nm (e,p, V) < (1 - &)Qh- Together with T h > T c this 
means that the heat flows from the higher temperature 
to the lower one: 



Q h > and Q c < 0. 



(23) 



For the efficiency of the work-extraction we get that it is 
always bound from above by the Carnot value 



r] nm (e,fj,,V) 



W nm (e,n,V) 
Qh 

< ?7Carnot = 1 



(24) 
(25) 



Eqs. (23-25) are, of course, well known in the ordinary 
thermodynamics. The advantage of the above derivation 
is that their validity is confirmed out of the local equi- 
librium [10] and without requiring a weak system-bath 
coupling. The latter assumption for deriving the Carnot 
bound is employed in Ref. [26]. 



C. Power of work extraction and cycle time 

As discussed above, the engine operation consists of 
two steps: work extraction during a reversible unitary 
transformation, which (in principle) can be implemented 
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in an arbitrary short time, and the heat gathering step, 
when the subsystems R and S relax back to their initial 
states under influence of the baths. This relaxation is in 
general irreversible, since, as will be seen below, at the 
moment when the second stage starts, the state of R (S) 
as given by (32) is not at local equilibrium with the hot 
(cold) bath. 

If the couplings of R and S to their baths were weak, 
the second step would take a very long time and thus the 
power — the work extracted per cycle divided over the 
cycle time — would tend to zero. 

However, the second step can also be implemented in 
a finite time: We may then assume that the couplings 
to the bath are finite, or even large, so that the relax- 
ation to the states (7) does not take very long, but the 
work-extraction stage is still, to a good approximation, 
thermally isolated. In Appendix A we describe a re- 
alistic relaxation mechanism that achieves a finite-time 
relaxation, but still allows a thermally-isolated work- 
extracting transformation, as described in section II B 1 . 

Thus provided we extract a finite amount of work dur- 
ing the first stage, we can get a finite power of work- 
extraction if the couplings of R and S to their baths are 
not weak. 



III. MAXIMIZING THE WORK OVER THE 
POTENTIAL V(t) 

We first optimize the work W nm (e, /i, V) in (18) over all 
unitary evolutions (17). This is equivalent to maximizing 
W nm (e, p, V) over all potentials V(t), defined in (15, 16): 

W nm {e,n) = maxy [W nm (e, p,V)} (26) 

This is a known problem in thermodynamics [1, 2]. 
However, the standard textbook answer to this problem 
applies only to macroscopic, weakly-non-cquilibrium sys- 
tems S and R. The general solution to the maximal work- 
extraction problem for a given initial state fli n was given 
in [25]. For the considered situation (7-12) this solution 
amounts to the following [25]. Once the initial state (and 
thus the initial energy) is fixed, for maximizing the work 
(18) one has to minimize the final energy (cf. (12-14)): 

nm nm 

tr[^O fin ] = ^^C a/3 P^ a , (27) 

a=l/3=l 

where 

C aP = {E a \U\Ep){E p \l^\E a ), (28) 

Note that C Q( g is a double-stochastic matrix, i.e., i) 
C a p > 0, ii) Yla=i C a(3 = 1 and E/j=i C a/3 = 1- Con- 
versely, any matrix that satisfies the features i) and ii) 
can be presented as in (28) for some unitary operator U 
[34]. A particular case of double-stochastic matrices are 
permutation matrices, which on each row and on each 



column contain one element equal to 1, while other el- 
ements are equal to zero. For this simplest case, which 
will be most relevant for our purpose, the relation with 
unitaries is especially clear, since the transpose n T of 
a permutation matrix n coincides with its inverse II -1 . 
Thus, n is already orthogonal (unitary). 

Now it is obvious [34] which double-stochastic matrix 
C a p minimizes the sum in the RHS of (27). This is a 
permutation matrix that enforces the largest element in 
E to appear in (27) paired with the smallest element in 
P. The one but the largest in E gets the one but the 
smallest element in P, and so on. Finally, the smallest 
element in P is paired with the largest element in E [34] . 

To write this down, let Hh be the permutation that 
orders the sequence E in (5) in the non-increasing order 

(tt H E) nm > (U H E) nm ^ > ... > {U H E) U (29) 

where (Hh E) nm is the largest element of Hh E which is 
obviously equal to e n + p n due to (8), (J\HE) nm -\ is the 
one but the largest element of E which in general is not 
anymore equal to e n + and etc. 

In the same fashion, let IIq be the permutation that 
orders in the non-decreasing order the sequence P in (13): 

(n f2 p) nm < (n n P) nm -i < ... < (n n P)i. (30) 

Note that (IIfiP) nm = r n s m and (IlnP)ii = risi due 
to (9). Then the minimal final energy can be written 
asEo™i(noP)«(n ff £) Q = E^n^iIfiP)^, where 
II^ 1 is the inverse permutation to II h ■ H^Hh = 1- The 
relation between Il^IInP and E is that if for any two 
indices E a > Ep, then (n^n n P) Q < (n^IInPJ/j. 

Thus the maximum of the work W over all interactions 
V(t) in (15) is equal to [recall (14)] 

nm nm 

W nm {e,n) = p <*E a - Y / ( n H lu nP)aE a . (31) 

a—1 a—1 

The maximum (31) is achieved for the final state 

fi fin = diag[n- 1 n n P], (32) 

which obviously has the same (but differently ordered) 
eigenvalues as f2i n , since eigenvalues (but not their or- 
der) are invariants of any unitary transformation. Thus 
tr(diag[II ff £] diag[n n P] ) = Ea=i( n ff n f^)«£« isthc 
lowest possible energy that can be achieved by permuting 
the eigenvalues of f2i„ [25] . 

Introducing the separate final states of R and S 

Pfin = tr s £!fi n , (jfin = tr R £l fin , (33) 

and using (16) one can write 

W nm (s, fi) = tr \{p - pfin)H R } + tr [{a - a Rn )H s ] . (34) 

Note that pg n and aa n commute with the respective 
Hamiltonians: 

[pan,H R }=0, [<7 fin ,# s ] = 0, (35) 
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and that they provide a larger probability for a smaller 
energy, i.e., the analog of (8, 9) is valid for pg n and aa n . 
Would not these both properties have to hold, one could 
extract more work from R and S. Note as well that in 
general pf\ n and a^ n do not have the Gibbsian form, i.e., 
they are not described by definite temperatures. 

The general form of the maximal work extracting in- 
teraction V(t) (see (15) for the definition) is given in [25]. 



IV. MAXIMIZING THE WORK OVER THE 
SUBSYSTEM SPECTRA 

A. Optimal spectral form 

We saw how to maximize the work over all interactions 
V(t). We now maximize the work W nm (e, /i) also over all 
energy level spacings {£k}k=i an d {wlE^ii i- e - over the 
initial state (12). The obtained value of work W will still 
be a function of Th, T c , n and m. 

So far we have not been able to carry out analytically 
the optimization of W over all possible energy spacings. 
Thus we have to settle for a numerical optimization of W 
employing the standard optimization packages of Math- 
ematica 5 1 . The result that emerged for 



n = m 



(36) 



has the following simple form: The maximal work 

W nm = max £i(1 [ W nm (e,fj,)] (37) 
is attained for 



A*n = A*rt — 1 



: £ 2 > £l = 0, 

H 2 > Ml = 0, 



(38) 
(39) 



that is when both upper levels £2 and // 2 are (n — 1) fold 
degenerate 2 . This result has been checked numerically 
for n = 3, 4, 5 and we expect it to hold for an arbitrary 
n = m. The intuition behind (38, 39) is that the energy 
is concentrated — as much as the thermal equilibrium al- 
lows- at higher energy levels creating a sort of instability 
that facilitates the subsequent work-extraction. 

For the occupation numbers one gets from (38, 39): 



Sr. 



r n -i 

: Sn-l 



r-i < n, 
■ s 2 < si. 



(40) 
(41) 



In the context of (38-41) we note that any state with 
occupation (40) and energies (38) admits a well defined 
temperature. While we shall elaborate on this point in 



1 More specifically, we used three packages based respectively on 
genetic algorithms, random-gradient search and stimulated an- 
nealing, to ensure that we get the correct results. 

2 Appendix B discusses in which sense the system with spectrum 
(38) is equivalent to a two-level system 



sections IV B 2 and IV B 3 below, it is important to stress 
already now that the existence of final temperatures came 
out as the result of maximization: in general the final 
state (33) do not admit any well-defined temperature. 

Once the fact of (38, 39) is recognized, it is not diffi- 
cult to get the explicit expressions for the maximal work 
and the corresponding efficiency at maximal work. The 
maximization of work will be split into two parts. First 
we shall explore several consequences of conditions (38, 
39) treating e n and /i„ as parameters. Then in section 
IV C we shall optimize the work over e n and fi n . 

Assuming (38, 39) we get from (4, 38, 39): 



E = [S2+J^2 , £2, JJ^ , 0] 

n—1 times n—1 times 

n—1 times 



(42) 



Analogously we get from (12, 40, 41): 

P = [ r 2 s 2 , r 2 si , n s 2 , n si] (43) 

n-l times times 
s v ' 

n—1 times 

When comparing E with P, we see that the action of 
Il^IIfi, as defined in (29, 30), amounts to interchanging 
the underlined elements of P in (43): 



n^iioP = [ r 2 s 2 , n s 2 , 



n — 1 times 



— l times 



T\ Si 



(44) 



n—1 times 



U = e 



-/3h£2 



One gets from (31): 

W nn (e 2 ,n 2 ) = (n- l)(e 2 - j^X^si - ris 2 ). (45) 

This equation can be re-written in a more convenient 
form by introducing new variables (Boltzmann weights): 

(46) 

(47) 
(48) 
(49) 

(50) 



so that 
r 2 



s 2 = 



1 + (n- l)u 

v 

l + (n-l)v' 
£2 = T h In ■ 



n = 



1 



\ + {n-l)u 
1 

l + (n-l)u' 
M2 = T c ln-. 



si = 



Eq. (45) thus reads 

(n -l)[u-v] [r h Ini-T c InI] 



W nn (u,v) 



(l + (n-l)u)(l + (n-l)v) 



Recalling (6), for the positivity of W nn (u,v) in (50) it is 
necessary to have 3 

u>v and T h ln- > T c ln-, (51) 

u v 



3 The inverse conditions u < v and Th In — < T c In — are not 
compatible with each other due to condition (6). 
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which together with (6, 46, 38, 39) leads to 



T c 



(52) 



For the efficiency of work-extraction we get from (19, 
24) and (51): 4 



Vnn(u,v) 



min [T ft lni,T c lni] 
max[T h lni T c lni] 



1 - — — f .(53 



Let us see in which sense this expectation is going to 
be correct. Recalling (10, 11) and (38, 39), the final tem- 
peratures T' h and T' c of R and S, respectively, is deduced 
from (54) 



si n 



lni 



In! 



(55) 
(56) 



i. C'arnot limit. 

Comparing (50) with (53) we see that for a finite n the 
efficiency tending to the Carnot value 1 — T c /Th means 
that the work extracted per cycle goes to zero [recall 
that the cycle duration is finite] . In section IV D 2 we 
show that for n — > oo this conclusion changes, and a 
finite amount of work can be extracted with the efficiency 
[almost] equal to the Carnot value. 

Note that the work turning to zero at the Ganot limit is 
typical for quantum realizations of the Otto cycle [11, 17]. 
However, there also the cycle duration is very long. 



B. Structure of the target state. 

1. Optimal work- extracting transformation. 

It is seen from (32, 43, 44) that under conditions (38, 
39) the optimal work extracting evolution amounts to 
exchanging the states of S and R: 



(54) 



The meaning of this factorization is discussed after (96) . 

The optimal work-extraction unitary operation is the 
so called SWAP, well known — especially for the partic- 
ular case n — 2 — as one of the basic gates of quantum 
computation [24]. Although SWAP is normally realized 
via composition of several more elementary unitary oper- 
ations [24] , its direct implementation for atomic few- level 
systems was argued to be feasible [33] . 



2. Temperatures after work-extraction. 

Recall with (6) that tti n is a non-equilibrium state. 
The final density matrix f2g n is also non-equilibrium, but 
it is expected to be closer to equilibrium than fi; n . 



Note that from (46) and (53) that for a fixed E2 and /12 we get the 
well known Otto-cycle result n = 1 — ^ , which is constrained by 
(52), but otherwise does not depend on temperatures. The Otto 
cycle is realized via two isothermal and two adiabatically [slow] 
processes; see, e.g., [11, 17]. Thus in this scenario the power of 
work is very small. In contrast, as we stressed already, in our 
situation the efficiency (53) is obtained with a finite power. 



With help of (53) and of the Carnot bound (25) we get 

T h > T' h , T C <T' C . (57) 

Thus the initially hotter system R cools down, while ini- 
tially cooler S heats up. Recall that the physical meaning 
of the Carnot bound is closely tied to the second law, i.e., 
to the impossibility of transferring heat completely into 
work. Eqs. (57) provide a somewhat different perspective 
on the Carnot bound related to the zeroth law. 
Another inequality is derived via (56, 52): 



r Ek < Ei < TnIL 

T'c M2 T c T' c ■ 



(58) 



This means that the analog of the condition (52) is not 
satisfied for the final temperatures T' c and T' h , so that one 
cannot, again, employ the final state in (54) for work- 
extraction via a thermally isolated process. 



3. Relation with the Curzon-Ahlborn efficiency. 

If R initially having a higher temperature than S still 
has this property after the work extraction, i.e., if 



we get, employing (56) that (59) is equivalent to 



Vnn > 1 




(59) 



(60) 



Here 7/ca is known as the Curzon-Ahlborn efficiency. For 
u and v satisfying to the work-extraction condition (51), 
inequality (60) may or may not be satisfied. 

However, below in (65) we show that if the maximal 
work (over u, v) is extracted, (60) always holds. 

Note that according to the Clausius formulation of the 
second law, if there is a heat exchange between two ther- 
mal systems, the heat goes from the hotter system to the 
colder one. Thus the temperature of the initially hot- 
ter system is always larger or equal than the one of the 
initially colder system. Now recall that the Clausius for- 
mulation in the present setup always holds globally in the 
sense that after the engine cycle is completed, the hotter 
thermal bath (attached to R) always has lost heat, while 
the colder bath (attached to S) always has gained heat; 
see (22, 23). Condition (59) tells that the heat goes from 



FIG. 2: Normal curves: efficiency r/„„ at the maximal work 
versus the temperature ratio = jr- for various values of 
the energy level number n. From bottom to top: n = 
2, 501, 1001, 10001, 100001. Upper dashed line: Carnot ef- 
ficiency »7camot = 1 — 0. Lower dashed line: Curzon-Ahlbron 
efficiency rjcA = 1 — V0. It is seen that ??Carnot > r\ nn > rjcA ■ 
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FIG. 3: The dimensionless maximal work versus the 

temperature ratio = ^ for various values of the energy level 
number n. From bottom to top: n = 2, 51, 251, 501, 1001. 



hot to cold not only globally (i.e., for the overall cyclic 
process of the engine functioning), but also locally, in 
the work-extraction stage. Indeed, the inverse condition 
T' h < T' c will mean that the initially colder system got 
hotter at the end of the work-extracting stage. Thus ac- 
cording to (60) the maximal work extraction is related to 
the local version of the Clausius formulation. 

Recall from (52) that for the work extraction at fixed 
spectra we need a finite difference between the tempera- 
tures. Condition (59), which is related to the maximiza- 
tion of work, shows that the final temperatures T' h and T' c 
have also to be different, in contrast to the classic thermo- 
dynamic case, where after the maximal work-extraction 
the overall system has one single temperature [1, 2]. 

C. Maximization of work over the parameters u 
and v and efficiency at maximal work. 




0.02 0.04 0.06 0.08 



u 

FIG. 4: The dimensionless work M/ ""j i "-" m ) versus the param- 
eter u. The parameter v is set at its optimal value Vm that pro- 
vides the unconditional maximum of v ^ t " . Here T c /Th = 0.5. 

J h 

Thick curve: n = 100. Normal curve: n = 50. Dashed curve: 
n = 10. It is seen that the maximum of ^oil gets larger and 
sharper for larger values of n. The same qualitative conclusion 
is kept for 



It remains to maximize the work W nn (u, v) over the 
parameters u and v: 



max Ujt ,[ VK„„(m, v)]. 



(61) 



Differentiating W nn (u,v) we get the following equations 
for u m and v m : 




where 



1 + (re - l)u m _ 
1 + (re - l)v m 
(1 _ Vm_, 1 + (n - 1)m b 
u m 1 + (re - l)v B 



T 

0=±£<1. 



(62) 



In — -6 In— , (63) 



(64) 



We see that u m and v m — and thus w ™(™™' v ™) an d 
the efficiency t) n „(ti m , v m ) at the maximal work — depend 
only on the ratio and the number re of the energy levels. 



For 6 = 1, Eqs. (62, 63) lead to u m = v m , and thus to 
W nn = r] nn = 0, as expected. For a fixed spectrum the 
efficiency re would not depend on 9 at all. This changes 
upon maximization of W: The behavior of r\ nn as a func- 
tion of 9 = T c /Th is shown in Fig. 2. While the Carnot 
efficiency rycamot = 1 — 6* is always an upper bound for 
T] nn , it appears that r/ also has a definite lower bound 
given by the Curzon-Ahlborn efficiency: 



Vn 



>)r, 



i{u m ,V m ) > T] C A = 1-V9. 



(65) 



In particular, r\ nn converges toward t]ca for Th — > T c ; see 
next section and Fig. 2. For small values of re, rj nn is 
closer to tjca than to 77carnot- For larger values of re and 
for 9 not very close to 1 , r\ nn is closer to recarnot . 

In addition, Fig. 2 shows that rj n n (for a fixed 9) mono- 
tonically increases with the number re of energy levels. A 
similar monotonous increase holds for the dimensionless 
maximal work W nn /Th; see Fig. 3. 
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Fig. 4 presents a projection of the landscape of the di- 



mcnsionless work 



We see that upon increasing 



n, the maximum of not only gets larger, but it also 
becomes sharper. (For increasing the visibility of this 
effect, is presented as a function of one parameter 
u, with another being fixed at its optimal value; other 
reasonable ways of taking projections around the max- 
imum lead to similar qualitative conclusions.) Imagine 
that various engines with different characteristics u, v 
and n operate between the two thermal baths. Now the 
engine with the best characteristics — i.e, larger n and 
with u and v closer to their optimal values for the given 
temperatures — will produce the largest amount of work, 
and will thus over-dominate the others. 



D. Special parameter windows 

1. Equilibrium limit 

For the nearly equilibrium situation Th ~ T c one in- 
troduces the small parameter e in the following way 



T h 



= l + eu, 



(66) 



Using (66) in (62, 63) and keeping terms <~ 0(e), we get 

(68) 



% = e 

1 _ 1- (n- l)e- 2w 
uj ~ 1 + (n - l)e- 2w ' 



Eq. (67) expresses v m via w, while (68) is a transcen- 
dental equation for u>. As graphical construction shows, 
(68) has a unique positive solution for n > 2. Combining 
(67, 68) with (50, 53) we get for the maximal work W nn 
and for the efficiency rj nn at the maximal work: 



W nn = 



e 2 m 2 e- 2 " 
(I + ne- 2 -) 2 



G(e 2 ), 



Vnn = ~ + 0(e 2 ), 



(69) 
(70) 



where w > is the solution of (68). As (70) shows, in the 
considered order ij nn coincides with the Curzon-Ahlborn 
efficiency: i]ca = 1 — VI — e = £ /2- 



2. Macroscopic limit: work and efficiency. 

If S and R are macroscopic, then Inn is large: 

hm>l. (71) 

Indeed for a system containing TV 3> 1 particles, the num- 
ber of energy levels scales as e constN . 



TABLE I: The maximal work W23 and the relative difference 
V23-VQA between the efficiency at the maximal work and the 
Curzon-Ahlborn efficiency for various temperatures. Here as 
in (81), the hot system R has two energy levels, while the cold 
system S has three energy levels. 





w 23 


V23—VCA 


T h = 2 T c = 1 


0.0891062 


0.0292807 


T h = 3 T c = 1 


0.265928 


0.0560355 


T h = 10 T c = l 


1.97317 


0.112379 




0.1 0.2 0.3 0.4 
efficiency 



0.5 



FIG. 5: The dimensionless work 



W ™W defined in ( 82 ) ver sus 

the efficiency r\. Recall from (82) that W nn (rf) is obtained by 
maximizing the work over all parameters for a fixed efficiency 
77. For this figure 9 = jr- = 0.5, and from bottom to top: 

n = 2, 51, 101. Note that Wn ^^ turns to zero two times: for 

■n — and for rj = r;carnot = 1 — 9. The maximum of 
corresponds to the overall maximization of work; see Fig. 3. 



Solution of Eqs. (62, 63) is found via expanding over 
the large parameter ln[n — 1]: 



)(1 - 6) ln[n - 1] 0+1- 



n- 1 



n- 1 



(72) 



1 



(1 - 6) [n - 1] In[n - 1] (1 - 9) 2 ( ln[n - 1] ) 2 ' 

(73) 

~1 



6 In [6»(1 - 6) ln[n - 1]] + 9 2 In 



■ ln[n — 1] 



(74) 



The first terms in the RHS of (72) and ( 73), respectively, 
are the dominant ones, while the second terms are the 

corrections of the relative order O [ , , 1 ) . 

Substituting (72, 73) into (50, 53) we get for the max- 



9 



imal work W nn and for the corresponding efficiency r\ nn 

(75) 



+ O 



+ O 



1 



ln[n - 1] 
26* 



ln[n - 1] 
1 



e 

(76) 

ln[(l-0) In[n-1]](77) 
(78) 



,(ln[n-l]) 2 J ' 

where <f> is given by (74), while the factors O ^ ln ^_ 1 j ) 
and 0( , ln , 1 _ 1 js 2 ) in (76) and (78) can be recovered with 
help of the correction in (72) and ( 73), respectively. 

It is seen from (75, 77) that the efficiency converges to 
the Carnot value, while the maximal work converges to 
the simple expression 



W nn = T h {l-6)\nn, 



(79) 



which is a characteristic input thermal energy Th In n 
times the Carnot efficiency 1 — 9. The corrections to 
these results — i.e., the last terms in the RHS of (75, 
77) — are important as well. They show that besides (71) 
one should satisfy 



(l-0)lnn> 1, 



(80) 



and that due to negativity of the corrections the actual 
values of W nn and r\ nn increase in the macroscopic limit. 



3. Macroscopic limit: structure of the engine. 

An additional implications of the macroscopic limit is 
that the temperatures T' h and T' c defined in (56) converge 
to Th and T c , respectively. This is clear from (77) and 

from = p- = 1 ~^ nra , which follows from (56). 

As follows from (80), the macroscopic limit is not com- 
patible with the equilibrium limit Th — > T c . An addi- 
tional obstacle for the macroscopic limit of the maximal 
work (but not of the efficiency) is 9 — > 0, since then the 
correction i in the LHS of (75) diverges. 

For 6 — ► 1 (or T c — ► Th) both the work and efficiency 
go to zero. However, according to (80) they tend to zero 
after having left the macroscopic regime (75-78). For 
this regime (80) implies that the relative difference 1 — 9 
should be smaller than t^— , where In n has the same order 

In n 7 

of magnitude as the number of particles. 

Note from (72, 73) and from (49) that the energy gaps 
Ei and H2 scale as Inn, as should be for a macroscopic 
systems. Another aspect is uncovered when comparing 
(72, 73) with (48, 49): in the limit (71) for the high- 
temperature system R the population is concentrated on 
the higher (n—1 times degenerate) energy level e-i , while 
for the low-temperature system S the population is con- 
centrated on the lowest (pi — 0) energy level. In par- 
ticular, this means that for both S and R in the limit 



(71), the canonical ensemble is equivalent (in the leading 
order of r^— ) to the micro-canonic ensemble, where all 

In n 1 ' 

the population is put on one [possibly (quasi) degenerate] 
energy level. This is what one expects for a macroscopic 
system. For the spectrum (38, 39), the equivalence of the 
canonic and micro-canonic ensembles holds under special 
conditions only, and those conditions are realized after 
the maximization of the work, as shown by (72, 73). 



4- System with n =fc m. 

So far we studied the case when both subsystems S 
and R have the same size, i.e. the same number n = m 
of energy levels. One may want to know what happens 
for n^m. One of the simplest models of this type is 



n = 2 



and 



to = 3. 



(81) 



While for to = n we had the conditions (38, 39), which 
considerably simplified the subsequent analysis, no ana- 
log of these conditions holds for (81). Thus we have to 
rely on numerical investigations. It appears that we can 
keep all qualitative conclusions; see Table I. 

i) The dimensionless maximal work is still a func- 
tion of the temperature ratio 9 = T c /Th < 1. ii) The op- 
timal values of the energy spacings — though not satisfy- 
ing any simple condition similar to (38, 39) — still depend 
only on 9. iii) The efficiency at the maximal work rj nm 
is still bounded from below by the Curzon-Ahlborn value 
1 — V0 and from above by the Carnot value 1—9. 



E. Conditional Maximum 

When seeking the maximum of W over the spectra one 
may impose additional constraints. We study two such 
scenarios below. 



1. Maximization of work for fixed efficiency. 

Consider the maximum of W nn (u, v) in (50), when the 
maximization over the parameters u and v is carried out 
under the condition of a given efficiency (53). This de- 
fines the dimensionless maximal work Wn "^ for a fixed 

J-h 



efficiency r\: 



T h 



= ma,x v 



(n—l)r][u — u e^jfoi 
(l + (n-l)it)(l + (n-l)u i « i 



(82) 



Note that W nn {v) is still a function of the temperature 
ratio 9 = 

As seen in Fig. 5, Wn ™^ as a function of 77 is a bell- 
shaped curve, which turns to zero once for 77 = and then 
for T] — rycarnot! recall the discussion in section IV A 1. 
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Fig. 5 shows that ^-W nn (rj) increases upon increasing 
the number of energy levels, while the maximum r\ nn of 
^W nn (rj) shifts toward larger values, since in the macro- 
scopic limit TjTj- W nn (77) will have its maximum very close 
to the Carnot value r\ = 1 — 9; recall (77). 



2. Emergence of the Curzon-Ahlborn limit during partial 
optimization of work: An example 

It may be instructive to follow in more detail, but 
via a particular example, how the Curzon-Ahlborn lower 
bound for the efficiency emerges during a constrained 
maximization. Assume that the systems R and S have, 
respectively, the spectra {or ej^j and {as£k}k=n 
which differ only by positive scaling factors an and as- 
The initial states of R and S are given by (7) . We shall 
not optimize over the interaction with the work-sources, 
but rather impose the SWAP transformation (54) for the 
work-extraction. The work extracted during this trans- 
formation is deduced from (18): 



for for very large temperatures it is zero again, since there 
is a maximal energy a finite-level system can have. Thus 
for a finite n, the ratio jf- may be larger or smaller than 
one, so that (85) does not imply any definite relation be- 
tween the actual efficiency (84) and the Curzon-Ahlborn 
value. However, for n = 00 the equilibrium specific heat 
can be [but need not be] a monotonically increasing func- 
tion of the temperature, since now the system can accept 
infinitely large energies. An example of such a behavior 
is given by a harmonic oscillator with frequency u, where 
e n = hun, and the specific heat is C — b 2 e b (e b — 1)~ 2 , 
with b = hoj/T. Thus, now ^ < 1, since T h > T c , and 
(85) implies that the Curzon-Ahlborn value is a lower 
bound for the efficiency (84). 

We draw two conclusions: i) upon partial maximiza- 
tion the Curzon-Ahlborn value may or may not be a lower 
bound for the efficiency depending on the system details; 
ii ) the emergence of the Curzon-Ahlborn lower bound is 
facilitated for systems with classical (i.e., unlimited from 
above) spectrum, since now the equilibrium specific heat 
can be an increasing function of the temperature. 



Wnn (or, as) = (an - a s ) e k (r k - s k ), 



k=2 



where r k 



and Sfc 



£p=i e 



— 



(83) 



-. In the 



second step the systems R and S are subjected to free 
relaxation, as described in section II B 2. Without loss 
of generality we assume ijP- < which means that R 
(S) has higher (lower) temperature 5 . The efficiency of 
work-extraction is obtained from (83, 19, 24): 



Vnn(an,as) = 1 . 

an 



(84) 



Note that the duration of the work extracting cycle 
is finite. Instead of doing the full optimization over as 
and an, we now employ a necessary conditions = 

= 0, for the work (83) to be optimal over these two 

parameters. Working out + = we get 



an 



T C C C 
ThCh ' 



(85) 



where C h = P 2 h a 2 R [(e 2 ) h - (e) 2 } and C c = P 2 c a 2 [{e 2 ) c - 
(e) 2 ] are the equilibrium specific heats of R and S, respec- 
tively, calculated for the initial states at the temperatures 
Th and T c (recall that Th > T c ). 

For a finite number of energy levels n, the equilibrium 
specific heat C is a non-monotonous function of tempera- 
ture: for low temperatures C naturally goes to zero, while 



5 Since wc did not optimize over the interaction with the sources 
of work, Wnn («r , as ) in (83) can be negative, e.g., for Th = T c , 
which means that the work is put into the system. 



V. OPTIMIZING THE SECOND STEP 

Now we want to extract work also in the second stage, 
i.e., during the relaxation of R and S. In contrast to 
the previous consideration, here we impose that the cou- 
plings of R and S with their respective baths are weak. 
We start at the initial state (12) of S+R. The maximal 
work-extracting transformation is applied, the work (31) 
is extracted, and R (S) is left in the final state pfi n (<7fi n ), 
as given by (33). Recall from (35) that pg n and aa n com- 
mute with their Hamiltonians. Due to the weak-coupling 
assumption the overall initial state of R (S) and the hot 
(cold) bath is, to a good approximation, factorized: p®pn 
(c ® cb), where pn, (cb) is the equilibrium state of the 
hot (cold) bath. Since the interaction with the bath is 
not essential during the first [thermally isolated] stage, 
the same factorization holds after this stage: pa n <8> pb 
and <7fin ® ctb • 

If we just let R (S) to interact with the thermal bath at 
temperature Th (T c ), it will relax back to the initial state 
p (a). We can however control this relaxation process and 
extract an additional amount of work. 

According to the standard thermodynamic argument 
[1, 2], the maximal work extractable — via a cyclic- 
Hamiltonian process — from a system in the initial state 
pen in contact with the thermal bath at temperature Th 
is bounded from above by the free energy difference 

AF R = tr[p fin F R ] +T/ l tr[p fin lnp fin ] 

- tr[pH R ] - T h tr[plnp] = AU R - T h AS R , (86) 

AUn = tr[p fin tf R ] - ix\pH K ], (87) 

AS R = -tr[p fin lnp fin ] +tr[plnp], (88) 

where p is the equilibrium state (7), and where AUn and 
ASn are the changes of the energy and the von Neumann 
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TABLE II: The maximal value of W33, given by (99) with 
maximization over the parameters u and v, compared to the 
maximal value of W33; see (61). The maximization is done 
for n — m — 3 (two three-level systems). We also present 
the relative difference 1)3 ^~^ CA between the efficiency 7733 at 
the maximal work W33 and the Curzon-Ahlborn efficiency 
t]ca = 1 — \/T c /T h . Recall that the work 2033 is extracted 
with the Carnot efficiency; see (95, 97). 





w 33 


V23 -VCA 
VCA 


OT33 


T h = 2 T c = 1.7 


0.009271 


0.000931 


0.0198908 


T h = 2 T c = 1 


0.128486 


0.0142578 


0.478908 


T h = 10 T c = l 


3.07425 


0.0711658 


9.20744 



entropy, respectively. 

A detailed discussion of (88) and its derivation is given 
in Appendix CI. Moreover, in Appendix C 2 we show 
that if the initial state commutes with the Hamiltonian, 
[pen, Hr] = 0, as is the case according to (35), the bound 
(88) is achieved via: 

(1.) Suddenly changing the energy spacings of Hr ac- 
cording to (C17, C18, C19). This brings R to the local 
equilibrium with the hot bath, since at the end of the 
sudden change the temperature of R is equal to the bath 
temperature T c . The change is sudden as compared to 
the relaxation time induced by the weak coupling to the 
hot bath, so that the interaction with the hot bath dur- 
ing the change is neglected. 

(2.) Slowly changing the spacings back to their initial 
values. Now the change is much slower than the relax- 
ation time of R driven by the weak-coupling with the hot 
bath. Thus R is always in the local equilibrium with the 
hot bath; see the discussion around (C21). The equi- 
librium state p is attained at the end of this isothermal 
process. The work-extraction in this stage takes a time 
much longer than the relaxation time of R which [due 
to the weak-coupling assumption] is already larger than 
internal times of R. Thus the overall process has a small 
work extraction power. 

The heat received from the hot thermal bath is (com- 
pare with (19)): 

Q h = tr(JT R p) - tr(ff RPfin ) + AF R = -T h AS R , (89) 



where AFr is given by 

The same procedure is applied to S thereby extracting 
the work AFg: 

AF S = tr[(T fin iJs] +T c tr[cr fin lncr fin ] 

- tr[aH s ] - T c tr[<7ln<7] = AU S - T C AS S , (90) 

where AUs and ASs are defined analogously to (88): 

AU S = tr[<7fi n fls]-tr[<7fls], (91) 
AS S = -tr[a fin In cr fin ] + trainer], (92) 

The total work extracted during the cycle reads 

20 nm (e,p) - W nm {e,p) + AF R + AF S (93) 
= -T h AS R - T C AS S , (94) 



where W nm (e, p) is the maximal work (34) [optimized 
over the interaction with the sources of work] extracted 
during the first stage. Note that the only feature of 
W nm (e 7 p) employed in passing from (93) to (94) is that 
the evolution of R+S in the first stage is themally iso- 
lated, i.e., W nm (e, p) is equal to the energy difference of 
R+S; sec (18). 

The efficiency that follows from (89, 94) is 



t nm {s,p) = 1 



T c AS S 
T h AS R 



(95) 



The work (94) is now optimized over the spectra 
£ n , £2 and p n , P2 of R and S, respectively, for fixed 
temperatures. 

For R and S having the same number of energy levels: 
n = m, the numerical optimization of (94) produced the 
same result (38-41) as for the work extraction at a finite 
power: the optimal work is achieved for the upper levels 
being n — 1 times degenerate. 

As we already know, Eqs. (38, 39) imply the factorized 
final state (32): p Rn — a and aa n — p; see (54). Recalling 
the definitions (88, 92) of ASs and A Sr., we get 



AS S + AS R = 0. 



(96) 



The physical meaning of this condition becomes clear 
when noting that if the factorization (54) was in- 
valid — i.e. if there were correlations in the final state 
(32) — the sum ASs + ASr would be larger than zero, 
as implied by the sub-additivity of the von Neumann en- 
tropy 6 . Since after the second step of the engine oper- 
ation, the systems R and S return to their initial states 
(7), the surplus entropy ASs + ASr has to be consumed 
by the thermal baths, thereby increasing their entropy. 
Thus, the factorization condition (54) eliminates this po- 
tential channel for entropy generation. 

Eqs. (95) and (96) imply that the efficiency is equal to 
the maximally possible Carnot value: 



£nn — ??Carnot 1 



(97) 



Using (46-49) we get for the work (94) 

W„ n (u,v) = {T h - T c ) (tr[<rlna] - tr[plnp] ) (98) 

m > [, 1 + (n — l)u 

(T h -T c ) 



+(n- 1) 



In ■ 

1 + (n- l)v 
vlnv — ulnu + [n — l)m;ln ^ 
(l + (7i-l)u)(l + (n-l)u) 



(99) 



The latter expression is to be optimized over u and v. 
It should be clear from our constructions that 



[W nn {u,v)] > W n 



(100) 



6 If Si2 = — trpi+2 fnpi+2 is the von Neumann entropy of a com- 
posite system with density matrix pi+2, then the sub-additivity 



implies [24]: Si +2 < Si + S 2 , where Si 
and where pi = tr2Pi+2, p2 = tripi + 2. 



-trpi In p^ i = 1,2, 
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It is seen that — analogously to W nn in (61) — is a 

function of the temperature ratio = j^. 

The difference W nn — W nn quantifies how much work 
has been traded in by sacrifying the power. As Table 
II shows, especially for Th ~ T c , the ratio can ap- 
proach <~ 20. 

A. Can one extract a finite amount of work at a 
finite power and with a finite-level engine? 

Recall that in section IV A 1 we discussed that when 
a finite-level engine approaches the Carnot efficiency at 
a finite power, the work extracted per cycle vanishes, 
though the cycle duration is finite. This is not anymore 
the case for a macroscopic engine, as we saw in section 
IV D 2. Above we have shown that if one imposes the 
zero-power condition, the work-extraction at the Carnot 
efficiency is possible. 

Can one extract a finite amount of work at a finite 
power and with a finite-level engine? In other words, is 
it possible to extract in the second stage the amounts 
of work (88, 90) without employing very long processes? 
The answer is yes [38]. A finite cycle time is achieved, 
since the coupling to the bath is kept weak before and 
after the work-extraction process, but it is made finite in 
the intermediate stages. However, the scheme proposed 
in [38] has a serious drawback: one should employ the 
sources of work-extraction that act not only on R and S, 
but also on the corresponding thermal baths. The latters 
are normally out of any direct control, and it is not clear 
to what extent the scheme proposed in [38] is realistic. 
Thus the question is open. 

VI. DISCUSSION AND CONCLUSIONS 

A. Summary. 

Our purpose was in deducing the physics of quantum 
heat engines from maximizing the work [extracted per 
cycle] under various constraints. We have found that the 
work maximization can be introduced on three different 
levels: 

I. Our model is described in section II; see also Fig. 1. 
One optimizes the extracted work over the interaction of 
the quantum systems S and R with the external source 
of work. In general, this procedure is not sufficient for 
extracting a finite amount of work at Th ^ T c . In ad- 
dition, the intermediate stages of the engine function- 
ing are not described by well defined temperatures: if S 
and R had well defined temperatures before the work- 
extraction, they are not guaranteed to have definite tem- 
peratures after (or during) this process. 

II. One maximizes the work, in addition, over the spec- 
tral structure of S and R. This turns out to be a cru- 
cial step, since after this optimization one finds that i) 
S and R are described by well defined temperatures in 



the intermediate stages of the engine operation, ii) The 
Clausius formulation of the second law — heat goes from 
higher to lower temperature — is satisfied not only for the 
total work-extracting cycle [as it should] , but also locally 
for the intermediate stages of the process. Thus the lo- 
cal thermodynamic structure emerges as a result of work 
optimization. Hi) The efficiency at the maximal work 
is bou nded fr om below by the Curzon-Ahlborn efficiency 
1 — y/Tc/Th- This is in addition to the upper Carnot 
bound 1 — T c /T h , which holds for this model generally, 
i.e., with or without any optimization. The important 
feature of these limits is that they are completely system- 
independent. 

Note that the duration of the engine cycle is finite. Thus 
the power of work is finite and [within our model] tunable 
to a large extent; see section II C for details. 

III. The Curzon-Ahlborn bound is approached close 
to equilibrium Th — > T c , while the Carnot upper bound 
is reached — at a finite power — for a large system S and 
R. In the latter macroscopic limit S and R (tuned to 
extract the maximal work) have the expected features 
of macroscopic systems, e.g., canonic and micro-canonic 
ensembles are equivalent for them. The equilibrium and 
macroscopic limits do not commute. 

IV. Finally, one optimizes the extracted work also over 
the interaction of S and R with their respective thermal 
baths. This optimization was carried out via increasing 
the cycle duration and thus reducing the power of work 
extraction. The main result is that the Carnot value for 
the efficiency — with a finite amount of work extracted 
at a small power — is reached for finite systems S and 
R. Thus there are two options for operating close to the 
Carnot efficiency: either one extracts a finite amount of 
work per a very long cycle, or a small amount of work 
per a finite cycle. 



B. Relation to previous work 

1. Curzon-Ahlborn efficiency. 

The Curzon-Ahlborn efficiency has repeatedly been 
found as the (approximate) efficiency of model macro- 
scopic heat engines functioning at a finite power [27, 28]. 
Ref. [7] studies a quantum heat engine model, and derives 
the Curzon-Ahlborn value, but in the limit of vanishing 
interaction with sources of work. Taking up the early 
approach of [27], it was stated recently that the Curzon- 
Ahlborn value is an upper bound for the efficiency of a 
heat engine operating at the maximum power and ac- 
cording to the rules of linear transport theory [29] . 

In contrast, we show that the Curzon-Ahlborn value is 
the lower bound for the efficiency at the maximal work 
and a finite power of work. This clarifies the meaning of 
the Curzon-Ahlborn value, since our derivation does not 
employ the linear transport theory, and is based on the 
fundamental level of quantum mechanics. It is important 
that rather different physical mechanisms can lead to the 
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same expression of the Curzon-Ahlborn value. 

2. Carnot efficiency. 

According to standard thermodynamics the efficiency 
of any heat engine is bounded by the Carnot value 
[1, 2]. Although this result was derived within 
(nearly) equilibrium thermodynamics, it can be extended 
to a rather general class of non-equilibrium heat engines; 
see (22, 25) and [10]. While useful as an upper bound, the 
Carnot efficiency by itself is often considered to lack prac- 
tical significance, since the the power of work goes to zero 
in this limit. This has been a motivation to develop the 
so-called finite-time [finite-power] thermodynamics [30] . 

The quantum situation can be even more restrictive in 
this context, since typical implementations are based on 
the Otto cycle, for which not only the power, but also 
the extracted work goes to zero when approaching the 
Carnot bound [11, 17, 20]. 

For a finite-level quantum heat engine operating close 
to the Carnot efficiency we have two related results. First 
we show that for such an engine operating with a fi- 
nite cycle duration, the work extracted per cycle goes 
to zero when the efficiency approaches the Carnot value; 
see our discussion at the end of section IV A. Second re- 
sult is that the same quantum engine can extract a non- 
zero amount of work — but with a long cycle duration — 
sharply at the Carnot efficiency, provided one properly 
optimizes also over the second step, the bath-engine in- 
teraction. 

Results on small quantum [5, 12, 13, 15, 16] or clas- 
sical [31, 32] engines working at zero power, but with 
the Carnot efficiency were already reported in literature. 



Most of these results [5, 15, 16, 31, 32] concern contin- 
uously [not cyclically] working engines, where the exter- 
nal source of work is absent and the work is performed 
by moving particles against an external force. In con- 
trast, Refs. [12, 13] report on a cyclically operating quan- 
tum heat engine that [at a small power] deliver with the 
Carnot efficiency a finite amount of work per cycle to an 
external source of work. Both these works attempt to 
model quantum Carnot cycle. 

We also show that the macroscopic engine can extract a 
finite amount of work at a finite-power and with [almost] 
the Carnot efficiency. To our knowledge this effect was 
so far never reported in the literature. 



C. Open questions. 

We leave open two important questions: 
(1.) How the engine tunes itself to the maximal work- 
extraction regime? Some hints on this point were ex- 
pressed at the end of section IV C. 

(2.) Can one extract work at a finite power by em- 
ploying a finite-level engine operating at the Carnot effi- 
ciency? This question was discussed in section V A. 
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APPENDIX A: COLLISIONAL RELAXATION. 

The purpose of this discussion is to outline a realistic 
example of a finite-duration [collisional] relaxation pro- 
cess which is consistent with the thermally isolated work 
extracting setup described in section II B 1. Our presen- 
tation follows to [23, 35, 36]. 

The thermal bath is modeled as a collection of N 3> 1 
independent equilibrium systems (particles) with density 
matrices u>i = exp[— flHi] and Hamiltonians Hi, where 
i = 1, .., N, and where 1/(3 — T is the bath temperature. 
This formalizes the intuitive notion of the bath as a col- 
lection of many weakly-interacting equilibrium systems. 

The target system R starts in [an arbitrary] initial state 
p and has Hamiltonian i? R . The collisional relaxation 
is realized when the particles of the bath sequentially 
interact [collide] with R. Consider the first collision. The 
initial state of R and the first bath particle is f2i+R = p® 
uj\ , the interaction between them is realized via a unitary 
operator V, so that the final state after the first collision 
is 0' 1+R = VSIi+rV^. Define separate final states: 

p' = triO' 1+R , wj = tr R 0' 1+R , (Al) 

where tri and tr R are the partial over the first particle 
and R, respectively. Recall the definition (21) of the rel- 



ative entropy. The unitarity of V implies 

S[Q'i +R \\ p' <8> ui] = tr[ni +R lnOi +R ] 

- tr[fii +R In(//®wi)]. (A2) 

Employing lui = cxp[— /3Hi] and S[fi' 1+R || p' ® wi ] > 
in (A2) we get 

TAS R + > 0, (A3) 

where ASr = tr [— p' In// + plnp] and AU\ = 
tr(7?! [lu^ — lui]) are, respectively, the change of the en- 
tropy of R and the average energy of the first particle. 

We now require that the that interaction V conserves 
the energy: AUi = —AUr. Using this in (A3) one has 

AU n - TAS R < 0. (A4) 

Since we did not use any special feature of the initial state 
of R, (A4) holds for subsequent collisions of R with the 
bath particles. Thus A<7r — TASr decays in time, and it 
should attain its minimum. It is well-known [1] that this 
minimum is reached for the Gibbs matrix p oc e~@ Hli : 
the collisions drive R to equilibrium starting from an ar- 
bitrary state. The coupling with the bath is switched on 
during the collision only, but since this coupling can be 
sizable, the relaxation time can be very short [23]. 

Further results and concrete scenarios of collisional re- 
laxation are given in [23, 35-37]. This includes the rate 
of [exponential] convergence to equilibrium which was 
favourably compared to experiments in [35] . 

As for the implementation of the work extracting pulse 
described in section II Bl, one notes that within the 
present relaxation model, the duration of the pulse has to 
be shorther than the time between the collisions. If the 
latter time is much larger than both the collision time 
and the pulse time, almost any implementation of the 
pulse will amount to a thermally isolated process. 

APPENDIX B: SYSTEM WITH n - 1 FOLD 
DEGENERATE SPECTRUM. 

Consider an n-level quantum system R whose upper 
n — 1 energy levels are degenerate; see (38). Let us show 
that the behavior of R is equivalent to that of a two-level 
system (n = 2) with respect to all transformations that 
do not resolve the n — 1 fold degeneracy of the spectrum 
(38). To this end we introduce for n = 3 generalized 
Pauli matrices [generalizing to n > 3 is straightforward] 

/i o o\ /o l\ 

0-3= 1 0,0-1=001,02= i<7l<T 3 . (Bl) 

\oo-iy \iioy 

It is clear that i) the algebra of these matrices is identi- 
cal to that of the corresponding Pauli matrices; ii) Any 
perturbation of the Hamiltonian Hr of R by an arbitrary 
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linear combination of {<7i}f =1 does not change the double- 
degeneracy of H^; in) If the initial state of R can be 
expressed only via {<7i}f =1 , then during any interaction 
with another quantum system — which is written only via 
<Tj and arbitrary operators of this system — R is dynami- 
cally equivalent (via the Hciscnberg representation) to a 
two-level system. An example of such an initial state is 
when R is described by a definite temperature. 

APPENDIX C 

1. Free energy bound for the maximal work 
extractable from a system in contact with a bath. 

We are given a quantum system in a non-equilibrium 
initial state <& and Hamiltonian H. Some work is to be 
extracted from this system via a cyclic-Hamiltonian, 

H(0) = H(t) = H, (CI) 

thermally isolated process. We want to give an upper 
bound for this work. The work-extraction process is uni- 
tary, and thus it conserves the eigenvalues of In par- 
ticular, it conserves the von Neumann entropy 

S[$] = -tr[*ln$]. (C2) 

Recall that the (positive) extracted work is defined as 
the difference between the initial and final energies. We 
can give an upper bound for the maximal extractable 
work by looking for a final state with the minimal energy 
compatible with the above conservation of the von Neu- 
mann entropy [1, 2]. The corresponding minimization 
procedure is standard in statistical physics [1] — since it is 
dual to the maximization of the entropy for a fixed aver- 
age energy — and it produces for the final state a Gibbsian 
density matrix 

$(/3 f ) = I e -A ff , Z = tie- fitH , (C3) 

with an inverse final temperature /3f defined via the en- 
tropy conservation: 

S{<f>} = S[<S>(f3 f )}. (C4) 

The upper bound for the maximal work is now 

W tb = ix[H$\-tr[H$(0t)]. (C5) 

This is the standard solution of the maximal work ex- 
traction problem given in thermodynamics [1, 2]. 

Let us now adopt the above reasoning assuming that 
the overall system consists of a large thermal bath B and 
a small system R. Initially B is in equilibrium at inverse 
temperature (3, while R is in an arbitrary state p. Thus 
the initial state is 

* = P®Pb(J3), p B ((3) = ^e-e H », (C6) 



where Hb is the bath Hamiltonian. The overall initial 
Hamiltonian is 

H = H R ® 1 + 1® H B , (C7) 

where is the Hamiltonian of R. 

We now employ the following facts: 
(1.) The number of bath degrees of freedom is much 
larger than that for the small system R. 
(2.) Since the bath started from a passive equilibrium 
state, the extracted work is expected to be of the same 
order as the energy of R. Thus the extracted work is much 
smaller than the bath energy. 

(3.) Since (i = O(Hr), the difference between (3 and (3f 
is expected to be much smaller than Hr. 
(4.) The interaction between B and R occurs only during 
the work-extraction process. It is negligible both before 
and after the process. The interaction may be sizable 
during the work-extraction, but the corresponding energy 
costs for switching it on and off are already included in 
the work. 

Let us now write (C4) as 

S[p] + S[p B (p)] = %(/3)] + S[p B (ft)], (C8) 

where p(f3) oc exp[— f3Hn], and where the LHS follows 
from the fact that initially the bath and the small system 
were in a factorized state. The RHS follows from the 
Gibbs density matrix (C3) of the final state, taking into 
account in the final state R and B do not interact. 

In (C8) we neglected the difference between (5 and /3f 
in S\p{(3)\. For the bath this difference should not be 
neglected, since this small difference is multiplied by the 
large number of the bath degrees of freedom. We write 

S[p B (f3 { )}=S B (U B + 6U B ), (C9) 

where U B is the initial bath energy, and where SU B is 
the change of the bath energy due to its interaction with 
the small system. Using dS B /dU B = (3 and expanding 

S B (U B + SU B ) = S B (U B ) + I3SUb, (CIO) 

we get from (C8): SU B = T(S[p] - S[p{/3)} ). Putting 
this into (C5) we get 

W th = ti [Hp] -tr [Hp(l3)]-T( S[p] - S[p((3)} )(C11) 
= Fi-F { . (C12) 

This is the difference i*l — Ff between the free energies, 
provided the latter is defined as 

F = tr [Hp]- TS[p\. (C13) 

Note that W t h hi (C12) can be written as W t h — 
TS[p\\p(f3)}, where S[p\\p(f3)} defined in (21), is the 
relative entropy between the initial state p and the final 
equilibrium state p((3) of R. 
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Reachability of the thermodynamical upper 
bound via a slow process. 



where Z = YJk=\ e ~ Pe ' k - Together with (C14, C16), 
Eqs. (C18) define the new spacings {e' n , ■ ■■,e' 2 }: 



One may hope that the thermodynamical bound (C12) 
could indeed be reached by some realistic work extraction 
dynamics [1, 2, 21, 25]. This is because for a macroscopic 
system (for the present case R+B) the conservation of en- 
tropy alone is expected to characterize a thermally iso- 
lated process. More specifically, we should demand from 
a physical realization of the bound (C12) that the work- 
sources act on the system and, at worst, at the system 
bath-coupling, but not on the bath itself, since the latter 
is supposed to be out of a direct control. 

A realization of the bound (C12) for restricted initial 
states p was outlined in [21]. This realization takes a long 
time and thus amounts to zero power of work-extraction. 
A finite power protocol of extracting (C12) from an ar- 
bitrary initial state p is given in [38]. However, this pro- 
tocol has another serious drawback, namely one has to 
allow direct interactions between the source of work and 
the thermal bath (uncontrollable degrees of freedom) . 

The result presented in [21] focussed on the zero Hamil- 
tonian case = 0. It is, however, possible to generalize 
this result assuming that the initial state p is diagonal in 
the representation of Hr . This restriction is essential, as 
we discuss below. Thus we write £/r and p as 

H = diag[e„, ...,£i], e n > ... > e\ = 0, (C14) 
p = diag[r„,...,n], (C15) 

where diag[a, ..,b] is a diagonal matrix with entries 
(a, ...,&). For simplicity we assume that the eigenvalues 
r k are ordered as 



r„ < ••• < ri. 



(C16) 



This assumption is not essential. If it docs not hold, 
one should supplements the step 1 below by the unitary 
transformation that orders properly the spectrum of p. 
The work extraction consists of the following two steps: 
1. One changes with time the level spacings from their 
initial values {e„, ...,£2} to final values {e' nl ...,e 2 }: 



{e„, £2} — ► {e'ni ■■~> e 'i}- 



(C17) 



The change occurs much faster than the relaxation time 
induced by the bath, so that the interaction with the 
bath can be neglected during the change. Since the cor- 
responding time-dependent Hamiltonian commutes with 
the initial density matrix for all times, the populations 
{r n , n} remain constant during this process. The pur- 
pose of (C17) is to achieve the local equilibrium of the 
system at the bath temperature (5: 



-0< 



P -/34 1 

r 2 = — ' r l=z> (C18) 



e> n =T i ln^,..., £ ;=Tiln^. (C19) 
The full work W\ done during (CI 7) is [initial average 



energy minus final average energy] 

n 

Wi = 5>kkb-4]- 



(C20) 



k=2 



2. The spacings e' n ,...,s' 2 are now slowly moved back 
to their original values e n , ...,£2- Here slow means that 
the characteristic time of the variation is much larger 
than the relaxation time of the system (determined by 
the coupling to the bath). It is at this point that the 
work-extraction process is going to take a long time. 

During this process the density matrix is 



P2(t) 



Z(t) 



diag 



-/3e„(t) 



Z(t) = £\ 



-Pe k (t) 



(,C21) 
(C22) 



fc=i 



where at the initial stage of this second step £jt (*i) = 
while at the final stage e k (tf) = £&■ 

The work done during this process reads 



W 2 



= - J ' d S p 2 (s)d s H( S ) = J 



tf d[TmZ(s) 



(C23) 



where Z(t) is defined in (C22). Working out (C23) one 
gets that W 2 is equal to the free energy difference: 



W 2 = -[tv(p(f3)H)-TS[p((3)} 

n n 

+ ^2,r k e' k + T^V fe In r k , 



(C24) 
(C25) 



fc=2 



fe=l 



where the RHS of (C24) is the minus final free energy 
with p(/3) = p 2 (U) being the final equilibrium state of 
R, and where (C25) is the free energy at the end of the 
sudden change defined in (CI 7). It is clear that the sum 
Wi + W 2 defined via (C20, C24, C25) is equal to the 
thermodynamic bound (C12). 

Since the local equilibrium is related to the simulta- 
neously diagonal form for both H and po, would there 
be initial coherences [non-diagonal elements of po] , there 
would be no unitary operation that could bring the sys- 
tem to the local equilibrium with the bath at the end of 
the first step. Thus the adopted restriction on the initial 
state is essential. 



